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ABSTRACT 


The purpose of this thesis is to validate the Navy 
Recruiter Selection Test Battery (RSTB) as a predictor of 
recruiter success. A sample of recruiters who took the 
test battery in 1982 was studied with respect to pro- 
Seetiviny Gf PeCruicing duty in subsequent years. The 
measure used to determine success on recruiting duty was 
average yearly production rates. Various statistical 
techniques, including cross tabulations, correlation 
analysis, and multivariate regression analysis, were used 
to determine the relationship between RSTB scores and 
recruiter success. The outcome of this research suggests 
that, overall, the RSTB is not able to predict recruiter 
success with a hich degree of accuracy. Biodgenmographic 
characteristics of the recruiters were also examined to 
Beue ry ine tf they couid be used, in conjunetion with the 


B, to predict success. The analysis suggests that the 


= 
ae 


occupational specialty of Navy Counselor could be useful in 


Screening for potentially successful recruiters. 
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I. INTRODUCTION 


Recruiting qualified enlistees into the Armed Forces 


these days 1s no simple task. Under the confines of 
maintaining an all-volunteer force, recruiters are 
Beemggliince to make their recruiting quotas. Pees nrimki ng 


pool of recruit-age, eligible males, competition from 
universities and the civilian job market, and a strong 
Seonomy Contribute significantly to the difficulties faced 
mememeccrurcting duty. 

The Navy mede its fiscal 1988 recruiting goals, but 


Gm’ barely... [Ref. 3 The delayea entry program (DEP) 


fe wa ad 


Meoe-—-recrultS waiting to enter the Navy--is shrinkinc. 
his puts pressure on recruiters to enlist recruits 
immediately rather than having the DEP cushion to fall back 
ong an Fiscal 188° ais iooking even more bleak. The 
recruiting budget 1S down mine percent from the previous 


ee a =: . > - = ~ on s+ 4 ‘wal ~~ oo 2 \, rc + Sr “. 
Meee ta ScoNcric Conditions are not improving from the 


Navy’s perspective. These added pressures make recruiting 
Bia even ee eee see Vee tO embers Ser tne jfilect . 


Additionally, concern for recruiter morale is increasing. 
The Navy believes it can alleviate its recruiting 
difficulties by iiGweactmg. recruiter’ billets, and by 
Meeraing more On eGucacional incentives and adcyertising. 
However, this approach only focuses on the supply side of 
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they receive the great 
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recruiter force. This entails selection of the personnel 
most likely to Succeed In recruiting eee If only 
successful recruiters are employed, the likelihood thag 
quotas will be filled and that the Navy will be able to 
meet its mission is increased. 

The costs of utilizing an unsuccessful recruiter are 
multifaceted. Poor recruiter-job matches lead to decreased 
productivity. This decreased productivity Can resi iieuees 
replacing the individual, which increases permanent change 
of station and temporary additional duty costs. It also 
increases tralning costs. The unsuccessful recruiter, woe 
probably was a top performer prior to recruiting dGurLy eee 


also affect those around him or her, both during the 


recruiting tour and afterwards. A negative attitude may 
sour performance in future assignments or may lead to a 
premature separation from the Navy. These costs to both 


the Navy ana the unsuccessful recruiter may be too high. 


A. PURPOSE 


The purpose of this thesis is to valiaate the Navy's 


Recruiter Selection Test Battery (RSTB) aS a predicroreen 
individual success on recruiting duty. The thesis will 
also examine the possibility that certain individual 


characteristics may be used to predict recruiter success as 
weli or better than the RSTB. If the RSTB Can be ~uscaee. 
select recruiters with the highest probabilities of 


success, the costs of failure can be avoided to some 


Sxcene.. The Navy gets a better recruiter force and 


recruiters who succeed will be happier. 


B. BACKGROUND 

From 1972 to 1976, Navy Recruiting Command (NRC) used a 
personality test, the 16PF-n, to screen and select 
recruiters. This test was designed to measure sales 
ability and motivation levels of the potential recruiter. 
ft was validated by S. Krug of NRC using Commanding 
Officers’ nominations of recruiters from the top and the 


bottom performance levels of personnel on recruiting duty. 


[Ref. 2} Muitiple regression analysis produced a .40 (p < 
oom) CSC COrrelation eoctircient between the test ana 
performance. When the test was cross-validated, the 
Boeerficient was .25 (p < .05). However, the use of this 


test waS discontinuedad in 1976 because NRC and the Chief of 
Naval Personnel agreeé that 1t did not truly predict sales 
prom ity. 

The Navy Personnel Research and Development Center 
(NPRDC, began working in this same area in 1975 in an 
Meremoo to aevelop @ good predictor of recruiter success. 
NPRDC researchers first identified behaviors that 
contribute to recruiter effectiveness and scales to measure 
those behaviors. [Ref. 3] These scales were then used to 
validate resuits of a test battery that was administered to 
267 recruiters from ten different Navy Recruiting Districts 
(NRD). This preliminary validation revealed a number of 
predictors that were related to performance. 
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NPRDC proceeded with another validation in 1981. [Ref. 
3}. It was conducted with 194 recruiters from seven NRDs. 
Performance measurements consisted of production data for a 
Six-month period and ratings gathered from peers and 
Supervisors in four areas of performance. The correlation 
coefficients between the recruMrers. ratings ana 
performance on the test battery were .43 in selling skills, 
-46 in human relations, .40 in organizing Skills) Sameeeee 
in overall pertormance. The overall correlation between 
recruiter proaguctlvity Games tese performance was .27. 
FiGiiwe= een represents) the practical impact Of "time 
relationship. Note that 66 percent of the recruiters 
scoring in the top 20 percent on the composite score were 
in the upper 56 percent in production, compared tome 
percent of tnose scoring in the lowest 20 percent. The 
researchers at NPRDC were convinced that thnis test was an 
effective measure of recruiter success--they recommended 
that the Navy and Marine Corps (USMC) implement this test 
to aiG in selection of recruiters. 

prior to implementation of tne test, the USMC requested 
that NPRDC conduct further validation for seiecting USMC 
recruiters anda 6 Bama | LAScCrUCEOme. Three more 
investigations were undertaken. [Ref. 4]. The first was a 
concurrent study of 1,065 “~USM@™=Nreceme teres The most 
notable result was that recruiters scoring in the lowest 20 


percent of the exam also had low production rates. The 


correlations netween the composite test score and measures 
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of performance were .22 for productivity ana .20 for peer 
and supervisor ratings, both significant at the .001 level. 
Figure 1.2 provides a further breakdown of the relationship 
between the composite score and recruiter productivity. 

The second procedure was a validation using Marines who 
were trackeq through recruiting school and then for one 


year of recruiting duty. Results were very similar to the 


CONCULTent VSEudrye Recruiters whose scores fell in the 
lowest 20 percent of the composite scores produced 
Significantly fewer enlistees. However, there was only 


slight differentiation among the higher scoring subjects. 
The correlation between production and the composite eeae. 
was .22 (pd < JGiaEe Figure 1.3 depicts the relationsiga 
between production anag composite score in more detail. The 
Griil instructor study revealed that the test correlated at 
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.001) with drill instructor school Conmpveniiaas 
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Again, NPRDC recommendead that the USMC ana the Navy 
implement this speciai assignment battery. 

One may cauestion whether these correlation statistics 
should serve as a basis for setting Navy-wide selection 
oie |sentae However, NPRDC’s original goal in developing this 
test battery was to identify, fleet-wide, those personnel 
most suitea for recruiting duty. Comparing the number of 
recruiters selected to the total number of prospects in the 
fleet, the selection ratio becomes quite small. Therefore, 
Se higher selectivity, a validity score on the test of 


.20 represents an increase in the probability of correct 
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Gecisions (selection of successful recruiters) over having 
no added screening. [{Ref. 5]. 

The RSTB 1S a composite of vocational interest items 
(the Strong-Campbell Interest Inventory), self-descriptive 
lists, and biographical data. Scoring of the test produces 
a composite recruiter potential score. This score can then 
be broken into measures of the individual’s selling, human 
relations, and organizing skills and overall performance. 
In 1981, NRC, attempting to implement the test, encountered 
Semomtcactons With Copyright infringement on a portion cf 
the test. By 1982 these problems were resolved and the 
battery waS administered to 270 Navy Enlisted Recruiter 
Orientation (ENRO) students, but the answer sheets were not 
processed at that time. 

The USMC has administered the test battery since 1985 
to students when they arrive at their recruiter schoci in 
San Diego, California. The test results were, at one time, 
utilized tc "red flac" those students who may need special 
attention. Tne resuits “were also compared, through 
Observation, to recruiter performance at school to verify 
the success of the USMC’s rigorous screening process. 
Meee. 6) According to a point paper written by Mr. Cc. 
Pemmapel of NRC: 

(USMC }) miecrmile ter school staff report noticeable 
muprovement in “trainee quality and a decline in 
Meer clOm trom recruiter school and the recruiter 


force. Unfortunately, they lack the empirical evidence 
needed to attribute the improvement directly to the use 


of the Special Assignment Battery (USMC form of the 
RSTB), policy chances and procedural changes which were 
implemented coincidentally. [Ref. 6] 
The Marine Corps 1S now only testing students to gather 
this empirical evidence and make a determination about the 
test’s usefulness [Ref. 8}. 

The USMC 1S not using the RSTB in the fashion that 
NPRDC originally envisioned. However, if testing were 
implemented fleet-wide, NPRDC hypothesized that over 
one-half of the attrites from Navy recruiter duty could be 
avoided. The Navy Recruiter Orientation Unit has a 
Six- to seven-percent historical rate Gf attri tromeaen 
that school alone [Ref. 9]. The goal of "ihws these ut wae 
explore NPRDC’s hypothesis and to give NRC the impetus to 


molement indicated improvements in current selection 
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procecures: 


C. ORGANIZATION 
This thesis 1S organize@d as Totlegee Chapter 
presents a review of the literature that describes other 


recruiter sezection methods and criteria “that Hhaveweeen 


researched over the years. Chapter 3 discusses the 
methodclogy utilized in valldating@ieno we... It alse 


contains a description and rationale for the success 
criteria used in this process. Chapter 4 presents data 
collected regarding the sample recruiters’ performance in 
the field and on the RSTB and a description of the 


biodemographic characteristics of these recruiters. The 


LV 


results of the validation are also discussed. Finally, 
Chapter 5 provides some conclusions about the validity of 
the RSTB and recommendations about its use. Additional 


research guestions are also examined here. 


Ii. LITERATURE REVIEW 


A. FOREWARD 

Many studies have been undertaken in an attempt to 
develop the ability to predict recruiter success. The waa: 
and the Army appear to be the most interested in this area. 
The Air Force has historically not had the problems with 
recruiting experienced by the other services. However, 
with the future outlook of difficulties for recruiGiaige 
this topic will be important to all services. Paper and 
pencil tests apparently have the longest history in being 
examined for their usefulness in selection procedures. 
Other methods such as biographical information, interviews, 
assessment centers, and most recently, expert systems also 
have been researched. 

One of tne biggest complaintS regardinc past research 
in this area has been the lack of cross-validation of 
encouraging studies. This occurs either because cross- 
validation 1S not attempted or the results of a cro 2 
valicgation are not aS promising as the original study. 
Cross-validation 1S a procedure used to test validation 
results. The prediction results derived from one sample 
estimation are applied to a second, separate sample. This 
is Gesignead to yielG an unbiased, consistent estimate of 
the population value. When this procedure is perfcrmed, 
however, researchers run the risk of introducing added bias 


resulting from sampling techniques. 


io 


Another common complaint is that criteria used to judge 
recruiter success are not very accurate. Researchers 
assert that productivity data are influencea by many other 


Verores WhichMare often outside the researcher’ s*contror 


Other measures, such as supervisor ratings or individual 
performance ratings are subject to bias. This may all be 
true. However, this 1S an imperfect world, and one must 


make use of what is available. Additionally, all services 
use production numbers as their measure of a recruiter’s 
performance. Until this 1S changed, numbers remain the 
relevant criteria om which to judge recruiter effective- 
ness. 

fie forMiowing is "=a discussion of specific research 
efforts that have been pursued in this area of predicting 
meenuiter success. This literature appears in chron- 


@eegica!l order to show the progression of this topic. 


B. LITERATURE 
1. Abrahams, Neumann anagd Rimlanad 

im AOrz) 1973, with the advent of tne Alljl-Volunteer 
Force, researchers became interested in studying methods to 
improve the chances of success for the all-voiunteer 
military. Abrahams, Neumann and Rimland examined the use 
of the Strong Vocational Interest Blank (SVIB) as a 
Meeaictor of recruiter success. [{[Ref. i0j. A group or ene 
least effective anda group of the most effective (judged 
by their Commanding Officers) recruiters from 42 Navy 
recruiting stations were administered the SVIB. Randomly 


ie 


selected SVIB’s from 178 recruiters were used to establish 
scoring weights for the test items. The remainder of the 
Sample was used to validate the scale of scores. After 
dividing the scores into four different groups, the resuime 
showed that the top group of scores came from three-times 
as many effective as ineffective recruiters, and the bowuem 
group came from ineffective recruiters three-times as 
often. Recommendations resulting from this work were to 
create a surplus of potential recruiters so that only those 
with the greatest likelihood of success need be selected. 
A method suggested to increase the pool was a shipmate 
nomination system. This would entail having, ideally, 
successful recruiters nominate former shipmates. These 
researchers alsc recommendeaq further developmentai effort 
on the SVIB tc brino it to its full level of effectiveneces 
along with the development of a biographical information 
scale and better criteria to judge recruiter effectiveness. 
The SVIB was obviously a precursor tc the cureen ee. 
2- Bennett and Haber 

This study, completed in June 1973, investicated 
the factors that influence the productivity of indiviremas 
Marine recruiters. [Ref. 11] Bennett and Haber selected 29 
recruiting stations throughout the United States to provide 
groSs productivity data on 259 )recrieeees The figures 
were based on the average number of recruits enlisted per 
NiGmits Her Tecnu tere Individual characteristics of each 


recruiter were separated into three types of variables. 


Selection, deployment and performance evaluation variables 
were used as explanatory variables of recruiter pro- 
Guctivity in two multiple regression modeis. Selection 
Variables were described as information known about the 
person prior to recruiting duty, such as General Classifi- 
cation Test (GCT) scores, age, race, education level, 
moluntariay “on recruiting duty, prior career planner» or 
Grill instructor experience, number of dependents and 
whether recruiting was believed to be a financial burden. 
Deployment variables consisted of geographic location of 
the duty and types of utilization of the recruiter. There 
were 16 total explanatory variables considered. One model 
was generated for high enlistment rate areas and one for 
low enlistment areas based on enlistment rates from 1971. 
This was done to account for an area’s effect on recruiter 
productivity. From both models, these researchers were 
aes LO come to the following conclusions: 
a. Individuals who had been career planners were 
likely to perform better than average recruiters. 


b. Recruiters assigned near their home areas may have 
an advantage in recruiting enlistees. 


c. A recruiter in an urban area appeared to have a 
better chance than one ina rural area of being 
Magpwiy preauctive. 


Individuals who felt that recruiting was a finan 
cial hardship were likely to be less productive. 


QO. 


The individual characteristics of the recruiter appeared to 
have insignificant impacts on success. This study was not 


cross-validated. 
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3. Best and Wylie 

In a Naval Postqraduate School thesis (June 1974), 
Best and Wylie conducted an analysis to determine the 
characteristics of above-average Navy recruiters and to 
give these recruiters a forum for their complaints. [Ref. 
12}. Forty-nine recruiters from the San Francisco d?Stiaae 
were surveyed using a questionnaire of four open-ended 
question areas. The Commanding Officer from they disteawese 
evaluated each recruiter on effectivenesS using a scale 
from one to five. Following an initial cross-tabulatioOneem 


the various survey responses and biographicai data, five 
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independent variables were used in a multiple regression 


eguation to Preaier recrumrer effectiveness. These 
Varlables were: area where the recruiter spent his or her 
youth (rural, suburban, urban), proximity of this area tome 
major body cf water, age, General Classification Test 
score, anc years of active service. The proportionwe: 
Variance in the dependent variable explained cy this model 
was .354. However, when the attempt waS made to cross- 


validate this model, the correlation between yvredicted and 
actual performance was cnly .1ll. 

Other findings from this thesis inciuded re- 
Ccruiters’ statements that the most positive aspect of 
recruiting @aduty was the independence of the duty and the 
least waS public’ speaking. These researchers concluded 
that the development of good measures of recrud@em 


effectiveness was important, despite their disappointing 


results. eye aso conciuded that the ™ié6PF-m, the 
recruiter selection method at that time, could potentially 
be a useful tool and further validation of it should 
ecomcinue. 
4. Borman, Hough and Dunnette 

In response to the problem of inadequate measures 
of recruiter performance, Borman, Hough and Dunnette looked 
at over 800 critical incidents in their research published 
in February 1976. {Ref. 13] These critical incidents were 


generated by input from 37 Navy recruiters and supervisors 


Mmecr all recrurtinoWareas. The researchers then reduced 
these examples ante eight representative behavior 
observation scales. The scales decided upon to judge 


recruiter performance were: 


reeeOcatIng and Contacting gualifieda prospects. 

ee Gaining and maintaining rapport. 

e Seealininoweantormation from prospects and makino 
HOocmperSon—-Navy fits. 

G@- Salesnanship skills. 

PM eaetanlishinge ana maintaining good relationships in 
the community. 


f. Providing khnowledeeable and accurate information. 
Pee AGministrative skills. 


fee oUppOrting other recruiters and the command. 


The researchers felt that using only these eight 
Gimensions may overlock or underrate a recruiter who may 


Meve a different style for getting the job done. 
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Therefore, they developed four different examples of “very 
high", "high", "low", and "very low", performance anes 
of the eight categories to aliow for these individual 
differences. 

A second approach taken in this study was a 
multidimensional scaling (MDS) approach. This led to five 
dimensions to describe the content of a recruiter Same 
These were: gathering information about applicants; 
planning and organizing recruiting practices--looking ahead 
to future requirements; expending extra effort to aia 


or recruits; salesmanship--listeninc to the 
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app 
prospect and then making an appropriate and effective sales 
pitch; and expending extra effort related to prospecting 
acti Tr o1ee- These five dimensions were then compared to 
the results of the behavior scalinc. The conclusions from 
this comparison suggest that MDS may provide "Cleancwas 


less highly ccrrelated performance categories than the 


However, a tield test was conducted using 27 
recruiters and supervisors from the Minneapolis, Minnes@ee 
area and the behavior scales. Results from this showed 
that peer and self-ratings could contribute Signiticanam 
to provide criterion performance scores because supervisors 
dc not normally possess detailed knowledge of recruiters’ 
performance in specific facets of the jom. Some aqa@aUrones 


recommendations stemming from this study included using the 


rating scales te assess the validity of procedures 
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presently employed to select individuals for recruiting 
Guty. The information contained here should also be used 
Sometrrorm — Commanding SOrfigers, potential recruiters, and 
newly assigned recruiters about what recruiting duty is and 
what performance standards should be met. 
5. Arima 

In June 1978, 'd. Arima had a study published 
entitled "Determinants and a Measure of Navy Recruiter 
Bifectiveness". [{Ref. 14] Using 268 recruiters from Navy 
recruiting stations in California, Arima developed a model 
ele: explain recruiter effectiveness. He sought to 
Gifferentiate in the measure of effectiveness how much 
individual characteristics and the operating environment 
affected productivity. He aisc examined several types of 
Peeetccivity measures, taking the quantity and quality of 
meerultis Ioo Consideration. Conclusions resulting from 
this effort were that the individual’s characteristics and 
abilities contributed as much as the recruiting erea in 
Beeler ning total production. Arima also stated that the 
Gesired measure of effectiveness should be the ratio of 
Meera! Proguctivity to expected productivity. This allows 
for differences between recruiting areas. One of his final 
recommendations was that this study should be conducted on 
a larger, more representative data base to g#in better 
understanding of how environmental factors affect re- 


Seri ting. 


6. Shupack 
In this Naval Postgraduate School thesis (June 
1979), Shupack intended to provide additional objective 
criteria to relate to recruiter effectiveness. {Ret liam 
Her measure of effectiveness consisted of the number of 
times the 1,262 members of her sample appeared on the Navy 


Recruiting Command Honor Roll (at least five enlistments 


per month). The researcher then conducted multiple 
regression analysis using pay grade, education, years of 
active duty service, General Classification Test score, 


Sales aptitude battery score, Navy enlisted occupation 


(rate) and age of the recruiter as independent variables. 
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She usec two models, one to predict success and one to 

failure. The results showed that the 
first model explained 14 percent of the variance am 
recrulter effectiveness. The second model accounted for 21 
percent for unsuccessful recruiters. The best preqi#ccomeaam 


model one was the recrulter’s education level and far meee 


Increased knowledge of the impact of various factors 
on recruiter performance would make it possible to 
Gevise more effective training programs ana heip to 
reduce costs due to recruiter turnover. Although the 
forecoing discussion has provided only a brief ex- 
planation of the other factors which impaceyemmae. 
cruiter effectiveness, it should be clear that research 
efforts which help clarify how these factors aai ce cau 
recruiter would contribute to the goal Of (yoOVvlaR Gea 
the most efficient and effective recrureing ores 
possibile. GRef. a. oe ce 
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7. Borman and Fischi 
Another method of evaluating recruiter performance 

has been examined in this work published in June 1981. 
[Ref. 16} Borman and Fischl examined the use of assessment 
centers aS a way to observe and evaluate performance 
Garegthy . The performance observed here was only related 
to training, not job performance. A problem with the use 
of assessment centers to determine probability of success 
is that the recruiter must have the desire to be there. In 
this day of involuntary assignments to recruiting duty, 
GeteevasiO’ nes become a prcblem and, therefore, the focus 
f attention. Assessment centers have now changed their 
objective from one of selection cf recruiters to providing 
potential recruiters a realistic job preview and positive 
feedback to enhance their motivation. [Ref. 2] 

8. Hirabayashi and Hersch 


Hirabayashi an@ Hersch conducted an analysis of 


Navy Recruiting Districts (NRD) to determine what makes a 
Gistrict exceilent, (published in December 1985). [Rei. 
ae) They interviewed over 100 officers, civilians and 


enlisted personnel at Navy Recruiting Comman@ (NRC), area 
headquarters, Navy Recruiter Orientation Unit, and members 
of the Standardization and Audit Team. The definition of 
excellence in recruiting duty employed by these researchers 
was the ability to make goal, in terms of both quantity and 
Seetity, consistently, and with integmaty. The tools found 


te be useful in meeting this goal were thought tc be 
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attitude, appearance, planning, training, marketing, and 
administration. 

These researchers then looked at two recruicimg 
districts that were universally agreed to be excellent. 
What they found from 67 interviews at these districts was 
that there are seven general areas where effectivenesams 
measured. These areaS include: leadership, systems in 
place (making effective use of the tools available), taking 
care of people, communication, teamwork, command climate, 
and making goal with integrity. These seven areas could 
presumabiv be developed aes. individual performance 
criteria; however, it was not attempted in this work. The 


recommenacations resulting from this thesis consisted of: 


a. Select quality recrulters to improve perionmen=ae 
b. Making goal shoul@ not be the only measure of 
effectiveness 
c. Improving recruiting’s appeal to the seimvorse = 
fleet. 
oS. Actiwecer 
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This Naval Postgraduate School thesis, completequims 
December 1986, was designed to identify personal attributes 
of the successful recruiter. [{Ref. 2] Using the @miput fren 
five United States Army recruiting experts, expert systems 
for each expert were constructed to profile the successful 
reerurcer- An expert system is a knowledge-intensive 
computer procran that soives a problem Cthaug NoOriauiia 


requires human expertise. Expert systemS Can be UseGuee 


Za 


assist in decision making by asking relevant questions and 
explaining the reasons for adopting certain actions-- 
reasons agreed upon by experts in the subject [Ref. 18}. 
Many attributes were examined in this resSearch, ranging 
from various skill levels to background information (for 
example, age and gender) to personality to previous 
experience of a recruiter. The most important attributes 
of effective recruiters that the experts agreed on were 
imeem ity, motrvation, “listening, informing, sales and 
recruiting experience, and training. 
16. Thomas, Kocher and Gandolfo 

This report of October 1987 appears to be a follow- 
on to Zellweger’s study inthe use of expert systems to 
meeogee recruiter success. {Ref. 19] A model using six 
reserve ana ten active duty Army recruiters was developed. 
This model was designed to measur the importance of 
recruiter attributes in six dimensions. These included 
M@mmenicetion Skiils, democraphic characteristics, military 
experience, personality, behavior characteristics and 
Specific experience. The reserve experts judged cognitive 
ability (Armed Forces Qualifyinae Test scores), persuasive 
ability, self-motivation, higher rank for the person’s 
Hength of service, and sales experience to be the char- 
feeetiscics most important tc the successful recruiter. 
The active duty recruiters preferred an individual who 
possessec public speaking experience and who had many years 


of active service (not related to rank) but who had 
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otherwise identical characteristics to the reserve experts’ 
"ideal" recruiter. The expert system developed was tested 
on 20 hypothetical recruiters and.a #fairlyeconsisetemm 
pattern of selection and rejection emerged. 
lise Lor ny 

This recent effort (March 1989) iS another look at 
the use of expert systems. [Ref. 20) Lorry identified 
eight attributes of the successful recruiter followaae 
interviews with 13 recruiting experts. She then designed 


an expert system which was able to recommend recruiters for 


(D 


recruiting duty based on the experts’ aSsessmentauses 


important characteristics. To validate the use of the 
program, a sample of 29 current recruiters was selected 
from NRD Los Angeles, California. The system gave an 


accurate recommendation on 21] of these recruiters (based on 
production per month as their measure of performance). 
This result equates tc a 72.4 percent accuracy rate vem 
provided a sample Commanding Officer’s Screening form 
which, if answered objectively, could be used as 2npuae 
an expert system similar to the one developed in this 
study. The use of this method for recruiter selectiom 
accerdina to Lorry and others, would provide an added 


"confidence factor" when selecting recruiters: 


C. SUMMARY 
It should now be readily apparent that the subject of 


predictina recruiter success has been studied quite 


extensively over the years. Researchers have produced many 
hypotheses regarding the correct measure of a recruiter’s 
SoOLLIcy . There are also many different results from these 
Seugies. 

One common conclusion shared by these studies is the 
need for the Armed Forces to select recruiters who are 
effective. It appears that improvements to the current 
method are highly recommended. The current method only 
requires a Commanding Officer to recommend an individual 
fee recruiting Guty via a screening sheet. This form is 
designed to ensure that the candidate has no medical, 
M@em@eal!, alcohol, drug, or financial «@ifficulties. A 
Commanding Officer is also encouraged to counsel pro- 
spective recrviters about the academic requirements of 
recruiting school and to relate the need of salesmanship, 
motivation,anc communication abilities usually needed to be 
peeeeccruiter f[Ref. 21]. However, whether this counseling 


@Seeurs i another guestion. AGGitionally, whether this 
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counseling and its results matter when detailers must fill 
feeruiter billets is cf equal importance. 

Another common finding in this research is that the 
Good recruiters share some common characteristics, such as 
motivation, sales ability, and intelligence. The RSTB, 
which has gone through several validations akready, 1s 
perceived by this author to possess the ability to predict 


recruiters’ qualifications in these areas anc more. The 
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III. METHODOLOGY 


A. DATA SOURCES 
1. Recruiter Selection Test Battery (RSTB) 

To examine the relationship between an individual’s 
score on the RSTB and his or her performance on recruiting 
Guty, it was necessary to score the RSTBS from the Navy 
Enlisted Recruiter Orientation (ENRO) students who took the 
test in 1982. Scores were generated for the individual’s 
human relations skills, selling skills, organizing skills, 
ana Overel! performance on the test. A recruiter potential 
composite score and percentiiesS were also generated. In 
mae spDOrman @€<. al. valication study @©f 1981, a sample of 267 
recruiters’ responses on personality and vocational 
interes= items were first correlated with the four 
subscales of the RSTB. The resulting correlation matrices 
were anaiyzeaq via the principal components method. From 
this analysis, constructs were developed to describe the 
RSTB responses in relation to the four subscales. Some 
examples of these test constructs and how they are related 
to each performance category are shown in Table 1. [Ref.3] 


pew sem -CeScrintion inventory of the RSTB is 


Gomposea of three sections: (1) a list of 100 self- 
descriptive statements: (2) a list of 935 adjectives; and 
(3) a list of 45 comparison adjectives. Each list requires 


the respondent tc answer "yes, this adjective describes me 


Meeeter)" Or "neo, it Gdoes not.” The background 


ray 


TABLE 1 


CONSTRUCTS IDENTIFIED FOR EACH PERKPORMANS eA eee. 


Performance 
Categories Constaiesr 
Personality Items 
Seda (oie 1s 1 Good Impression. 
2 Impulsive vs. order, planning ahead. 
3 Enjoying being center of attention. 
4. Working hard, being Happy VS. sai 
happiness, giving up easily. 
Human Relations ih Likes working, being with people. 
Sia isrs 2. Spontaneity, impulsivity,rebel- 


ORS ain tae 


Ska is 


Overall! 
Performance 


Selling Skiils 


Human Relations 
Ski lise 


Organizing 
Sige 


tL) 


() NO 


mm G) RD 
s e 8 ® 


licus, tendency to have bad moods. 
Unhappy, lack of confidence. 
Ambitious, working hard. 


Crder, planning ahead, well organ- 
ized vS. impulsive, "ase 
careless." 

Leading, influencing others, 
ambituous. 

Unhappy, discouraged, feeling 
useless. 

"Bad actor,” unSGeializecr 


Doing more than expected vs. giving 
upe 

Impulsive vs. order, methodoiogical. 
Leading, influencing others, 
dominant. 

People oriented, open to people. 


Vocational interest Items 
Leadership activities, occupations. 
interest in law and politics. 
Interest in sports, competitive 
activities. 


Interest in social actiyviuwess 
interest in teachinc, counselling. 
Interest in newSpaper reporting. 
Interest in Sports and religion. 


Interest in upper management, pol- 
pbiaskors e 

Interest in bookkeeping, detail 
Wot ke 

Interest in leadership, responsi- 
Dia vee 
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TABLE 1 (cont.) 


SeistRUCTS LDENTIPLPED FOR EACH PERFORMANCE CATEGORY 


Overall 1. Interest in law, politics, manage- 
pert ormance ment. 
Qo eaeerest in Sports. 
3. Interest in teaching, counselling. 
4. Interest in occupations that re- 


Guire extroversion, dominance, 
responsibility, and leadership. 


Seurce:) {(Reil. 3] 


questionnaire contains 136 questions concerning jobs and 
activities that the individual may have performed in the 
fpast . Vocational interests were determined from a check- 
list of 325 options that described a respondent’s interest 
ieeparticular occupations. The RSTB has a total of 701 
cuestions for the recruiter to answer. 

There were 271 answers sheets obtained from 2706 
ENRO students who took the test battery over the period 6 
Mey 1962 to 1] October 1982. An average ciass at ENRO (now 
@e1e0 Navy Recruiter Orientation Unit {NORU}) consists of 
Peemoximateiy 35 to 40 students [Ref. 22}. A class 
is convened once every week. Therefore, there were most 
likely between 420 to 480 students at ENRO during the 
testing period. This sample of 270 recruiters represents 
approximately two-thirds to one-half of all of the students 
at the command over this three-month period. Since the 
Sampling appears to be widely distributed, it is hoped that 
aS sample one 2G recruiters is a random and 
representative sample of all recruiters. 
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In the analysis below, individual recruiters are 
tracked by their social security numbers. The records of 
four recruiters were declared void by the scoring machine 
at Headquarters Marine Corps due to the number of missing 
responses. Thus, the number of recruiters’ scores 
available for analysis is 266. 

2. Productivity 

Measures of success for this sample were somewhat 
limited by a lack of data from Navy Recruiting Command 
(NRC). Productivity figures were not maintained by NRC for 
the time period that the recruiters in this sample were on 
recruiting duty. Other constraints, such as time and scope 
of this thesis, limited the ability to gather performance 
evaluation data cr supervisor/peer rating data on this 
Sample, aS utilized in previous studies [Ref. 10 and 13}. 
Other research products have avoided using unaltered 
productivity data because the researchers felt that these 
data are inadequate, unrepresentative measures of success 
(Ref. 13, Pee eege oe However, previous validations of 
the RSTE have made use of productivity as an indicator of 
success [{Ref. 3 and 4]. Using this type of data for nw 
research will enable comparisons between previous results 
ana the results of this thesis. 


To obtain productivity rates for this ’sanptoues 


recruiters, some improvisation was necessary. The Center 
tier Naval Analyses (CNA) maintains data from the 
Personalized RECEULE IAS ers Immediate and Delayed 
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Enlistment (PRIDE) system. PRIDE is designed to manage and 
Semesomechne “secruiting = process. [{Ref. 23) fee mtalcnes 
recruits with programs for which they qualify, it assigns 
recruits to A-schools, and it identifies specific jobs for 
which the recruit is most qualified. The PRIDE system is 
basically a reservation system for recruits. When a 
Feservation iS made, most of the data elements are reserved 
mer recruit information. However, the recruiter’s social 
security number (SSN) also is Supposed to be recorded, as 
well as the area from which the individual is recruited and 
few tiscal year of the accession. Productivity of the 
recruiters in this sample is generated from this file. One 
potential drawback of using these data is that if a recruit 
goes intc a general detail assignment, without first going 
to an A-school, the enlistment may not be recorded in the 
same system. 


CNA was provided with a list of the recruiters’ 


ents . The system provided recruitment numbers for 243 of 
the recruiters in the sample for fiscal 1983, 236 for 
mmeeag!) 1984, 172 for fiscal 1985, and 120 for fiscal 1986. 


Average yearly production figures were calculated on those 
recruiters who were productive in at least fiscal 1983 and 
fiscal 1984. If the recruiter remained in the file for 
fiscal 1985, an average yearly productivity {igure was 
calculated including that year. Of those seven recruiters 
who droppec out of the file between fiscal 1983 and fiscal 


1984, one could potentially assume that they were not 


iit 


productive, had left recruiting duty and, therefore, were 

nNOe suseessfiule However, the reasons why recruiters are 
dropped from the file are varied and may not represent 
problems in meeting recruiting goals. For example, a 
recrulter may stop producing recruits due to a promotion to 
Recruiter-in-Charge or Supervisor. He or she also may have 
left recruiting duty for medical or retirement reasons. 
Therefore, this author does not feel that making an 
assumption about a recruiter being unsuccessful because of 
no observeG prceduction, is valid or warranted. The seven 
recruiters whe did drop out of the production file betwear 
fiscal 1983 and fiscal 1984 were eliminated from the 


Sample. 


Another measure of success ana a potential data 
source for this analysis is whether or not the pecrurees 
remained on recruiting duty for the full three-year period 
that represents a normal recruiting tour. Again, decreased 
numbers of matches of recruiter SSNs in the productivity 
Gata may be attributable to those individuais who did not 
succeed at completing the full tour of duty. 

The ideal data source for this information would be 
tom identify those recruiters who were remcved from 
recruiting duty for lack of ability to recruit Gr ne oeeee 
words, those who transferred under the Freeman Plan. [Ref. 
24] A Freeman Transfer is not prejudicial in design and is 


not to be used as a method of removing personnel who 
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have disciplinary problems. Po must be initiated by 
Commanding Officers and can be designated as either "fault" 
gm no-fault." It occurs when a recruiter fails to meet 
the NRC reguirement of averaging at least two new contracts 
per month by the fifth and sixth months of duty or when the 
average falls below two contracts per month for four 
consecutive months. 

These data were not available from NRc for the time 
period desired. Therefore, an alternative was adopted to 
determine Ssuccess--namely, those individuals were 
Meentifiec whe Separated from active duty prior to the 
completion of their three-year tour and who separated for 
reasons that may indicate lack of success. These data are 
availiable on the Enlisted Master and Loss file, maintained 
by the Defense Manpower Data Center (DMDC). If the 
individual separated between October 1982 and October 1985, 
a loss code was generated that could be used to indicate 
Me. Of Success on recruiting duty. me eocal, of a3 


individuals were identified through DMDC’s loss file. 


Table ? showS a breakdown of numbers, dates, ana 
explanations for the loss code. It should be noted that 
"loss", in this instance, 1s somewhat of a misnomer. Many 


mosses" were actually recorded at DMbDC for transaction 
purposes (immediate reenlistment)--the recruiter did not 
Separate. Other losses are attributed to non-problematic 
Causes, including commissioning and retirement. It is not 


clear why certain people (e.g., those with medical problems 
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TABLE “2 


CHARACTERISTICS OF RECRUITERS IDENTIFI LUNAS ieee 
ON ENLISTED MASTER AND LOSS eee 


Was 
Separation Recruiter 
Code Description Frequency Date of Sep.” Successful? 
Unknown/Invaliad 2 841005 Yes 
850606 Yes 
Expired Term of 19 Yes 
Service 
Early Release/ 2 S31.037 No 
Insufficient S5lziz No 
Retainability 
Disability with I SS Ca Yes 
Severance 
Temporary Disability-- 2 850565 Yes 
Retired 851018 Yes 
Heioht/Wweight 1 5 ee Yes 
Standards 
Death--Non-Battle Z Yes 
Conmissioned 2 830630 Yes 
830930 Yes 
zO-30 Years Service ae S31 032 Yes 
a4 Yes 
S§4C732 Yes 
54 Ge Yes 
Sa eso Yes 
Sato Yes 
S501 38 Yes 
S50223 Yes 
§50631 Yes 
850930 Yes 
85) 0s Yes 
So 0 oe Yes 
851105 Yes 
DEScreditazie a 84579 No 
incidents 
Druas 2 840508 No 
$5 ies No 
UnStitaby eee. 1 85CE20 NO 
Unknown Reason 
Committed Serious a0 850122 No 
Offense 
Transaction Code-- 74 Yes 
Immediate Reenlist- 
ment 
“Date of Separation = Year, Month, Day 


Securce: Derense Manpower Data Center 


or those eligible for retirement) were selected for 
recruiting duty. The dates of these losses may provide 
Pemoeimsignt, but further inquiry into this question will 
not be undertaken at this time. 

A difficulty encountered in these data is the lack 
SieoVariability. As shown in Table 2, only seven 
individuals in the sample could be considered unsuccessful 
with certainty, based on the established criteria. 
Miererore, Chis basis ~of validation is not pursued any 
mer cner . 

4. Biodemographics 

Other information 1s available from DMDC’s files. 
From the Enlisted Master and Loss file, biodemographic 
information was provided on 267 of the recruiters in the 
sample. These data are used to develop variables to 
explain recruiter success. The purpose of this analysis is 
meme nold biodemcgraphic characteristics constant when 
Meeomietinc recruiter success as a function of the RSTS. 
This approach represents a multivariate analysis, which has 
not been used in previous validations of the RSTB. The 
Master and Loss file’s information from DMDC was merged to 


generate complete data on each recruiter in one file. 


B. VARIABLE IDENTIFICATION 
1. Dependent Variable 
Success of a recruiter in this analysis is based on 
productivity figures. Because there were only 236 ultimate 
Memeenes between RSTB scores, biodemographic data, and 
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production statistics, this number represents the total 
sample size for all analyses. Success in productivity can 
be defined in the same manner here aS in NRC’s criteria for 


Freeman Transfers: [Ref. 25] 


Production recruiters are required to attain a 
monthly productivity of 2.0 gross néw Contracts upe: 
month by the fifth and Sixth monenwor aguas A 
production recruiter is defined as a recruiter who is 
directly involved in prospecting and writing contracts 
to bring applicants into the Navy and whose production 
of such new contracts is recorded in COMNAVCRUITCOM 


PRIDE reservation system. It does not apply tovchtes 
recruiters, zone Supervisors, classifiers, RZ 
coordinators 


This Géfini tion provides a very plausible 
explanation for recruiters disappearing from the PRIDE data 
f ive Baseqd on the productivity numbers generated from 
CNA’‘sS PRIDE data, and using the definition provided by NRC, 
productivity for the recruiters of this sample shouid have 
reached two new contracts per month by the middle of fiscal 
1 oeae It should aiso have reached at least 24 new 
contracts in both fiscal 1984 and fiscal 1985. 


For the first two years the average expectea number 


of contracts is 18 per year. If the recruiter remainec fof 
fiscal 1985, 24 contractS are expected pemwiyecanyaee. 
average. Success iS thus defined as a binary variable 


wnere the recruiter either produced 18 or 20 contracts 
(depending on whether the recruiter was productive for 
fiscal 1983 and fiscal 1984 or productive during all three 
years) per year (success = 1) or he/she did not (success = 
GC). A second definition of success 18S also constructed 
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when production exceeds 30 average contracts per year. The 
intention is to compare the two sets of results to 
determine if there is a difference in the power of the 
model between the two measures of success. A third measure 
of success iS average production per year, which is used as 
a continuous variable. These three alternative measures of 
SUCCeSS provide the ability to examine changes in 
productivity related to the explanatory variables in a more 
detailed fashion. 
2. Explanatory Variables 

Explanatory variable selection is based on three 
@rrteria: previous studies, availability of data, and a 
hypothesized relationshion between the variable and the 
individual’s success. Each of the subscales of the RSTB is 
used. Raw scores for human relations skills, selling 
skills, organizing skills, and overall performance are 
Macluded in the analysis. wae “recruiter potentzal 
compcsite percentile score is alse considered independently 
of the subscales. Other variables used are discussed in 
Greater detalii below. 

PREG: * Aptitude can be judged by the service 
member’s score on the Armed Forces Qualification Test 
weet) at entry into the military. A binary variable was 
Memes ructec sc that AFOT categories 1, II, IIIA (meflecting 
scores at or above the 50th percentile) are set equal to 
one, and the lower AFOQT categories equal zero. Because 36 


AFOT scores were missing, it was necessary to replace them 
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with predicted AFQOT scores. The scores were estimated 
uSing ethnicity (white/non-white) and high school (HS) 
graduation as explanatory variables and using the sample of 
individuals with AFOQT scores. The resulting equation from 
this estimation is: 

Predicted AFOT = 23.22 + 17.92(HS) + 27.25 (white). 
The amount of variation in AFQT scores accounted for by the 
explanatory variables (Rep equals .24. 


AGE: This variable was generated using the 


recruiter’s year of birth. The recruiter's age im 19esu ae 





calculated. 
SINGLE MARRIED MARIKID MAR2KIiD4m: Binary 
Varlables were. createo Wire the marital status ane 


‘dependents’ fields on the Enlisted Master and Loss file. 
The maritai status field egualis one for unmarrieag perconmes 
and it equals two for married individuals. The recruiter 
waS included in the ‘dependents’ field, along with any 
family members. Therefore, the ‘dependents’ field iaeaa 
minimum value of one, whether the recruiter has dependents 
OF Get. Tf amarried recruiter has a spouse who 1S not 
actually a dependent, the ‘dependents’ field would still 
equal one. For the purposes of this thesis, when the 
‘dependents’ field has a value of one or two and marital 


status equals two, the MARRIED variable egquais one, (1.ée., 


the individual 1S married only). Single recruiters 
(without dependents) are icentified wnen marital status 
ecuals one anc ‘dependents’ egquais one. The MARIKID 
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variable consists of those individuals with two dependents, 
primarily a spouse and one child (1.e., marital status 
equals two and ‘dependents’ equals three}. MAR2KID 
represents those individuals with two or more children. 
The base case is a person who 1s single but has one or more 


emidaren. 

HS: This binary variable was created from the 
education level field on the Enlisted Master and Loss 
file. This field contains the person’s highest level of 
education, ranging from one (one tc seven years of 
peamerientary sSchooij)j to tz (doctorate degree). SHEL 
represents a high school graduate with a dipioma, an 
attendance certificate, eig a General Educational 
Development (GED) certificate. Anyone with a value of six 
Semeecreater in this field was converted so that the 
Weidgable, HS, eguels one; otherwise, HS equals zero. In 
December 1987, DMPC restructured this field to record GEDs 
anu alternate educaticn credentials separate from high 
school] diplomas. This 1] "ear ciculariv useful when 
MeeenelOnm ant turnover issues of the military are studied. 


However, this breakdown. cannot be used for this sample of 


Mecruiters. 
om TE: This variable, constructed from the 
Memeevechhicity field, is also a dichotomous variable. 


White recruiters are placed in one category; all others 


made up the second category. 
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MOS: This data element 1S a S@rvice Geode tome 
member’s primary occupation (or Military Occupational 
Specrateey) - An individual’s rating 1S contained in the 
first three positions of the field and the Navy Enlisted 
Classification code is in positions four through seven. 
For the purpose of this analysis, only rating is used] ine 
rat rcceot the recruiters in this sampie have been 
consolidated using the Department of Defense Occupational 


Conversion Manual {[{Ref. 26]. The categories were turned 


into dichotomous variables in the following manner: 


MOSiI;: Navy Counselor 

MOS2: Those recruiters with occupations tiemeae. 
strictly administrative, including: YN) ei 
AZ, Ak. 


MOS3: Specialists including: AC, AG, BMS GTO eae 
DT, GMG, GMM, MS, OS, PH, RM, Snare 





Benes 

MOS: Repairers, including: AB, ABE, ABH, AD, AE, AME, 

AMH, AMS, AO, AO, AS, AT, BT, BU, CE, CM, DS, 

EM, EN, EO, ET, FC, FIM, “(GC ee 

OTM, OTA, STG, STS, Sk, 12 eo 

AREA: A binary variable was generated for each of 
the six Navy recruiting regions or areas. These areas are 
shown in Figure 3.1 [{Ref. 21]. Areas were reported on the 


PRIDE data file when contracts were made. This variable 1s 
intended to account for variations in productivity thaceeas 
be attributed to the region in which recruiting occme. 
The variations can include unemployment rates, eligible 


male populations, and basic attitudes toward the military. 
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It shouid be noted here that these data are somewhat 
limited, and this limitation affects the analysis. There 
are 41 Navy Recruiting Districts (NRD) and differences 
across districts can have a large impact on whether or not 
recruiters achieve recruiting goals. Motivation can be one 
of the biggest factors. A particular district’s Commandcame 
Officer or Recruiter-in-Charge can have a dramatic effect 
on the motivation of a recruiter and productivity levenee 
Other examples of such variations between individual 
districts include stress levels, proximmicy "cowed, te Bie 
base for support, and physical working environment. 
Unfortunately, PRIDE does nee report accesSions by 
Gteer Bere Additionally, a sampie of only 236 recHa@ reer. 
does not lend itself to the creation of 41 variables fo 
account for Gifferences between NRDs. 

Sex and pay grade were two other elements provided 
which were considered for use in this analysis. Sex was 
nox used because of lack of variability within the sample. 


There were onlv nine females who had exam scores and 


productivity figures. Pay grade was found to be 
significant in” previouS Yresearch concerning Yrecrurees 
success [ R@i ame on. During preliminary analysis, however, 


pay grade was found to be highly and significantly 
correlated with ade. Also, according to the enlisted 
recruiter detailing office at the Naval Miiitary Personnel 
Command, potential recruiters must be in the pay grade of 


- 
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E-5 or above to be assigned to recruiting duty [{Ref. 27}. 
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Therefore, to avoid problems with multicollinearity and 
selection bias in the analysis, pay grade is not used as an 
explanatory variable. 

The hypotheses underlying the selection of these 
variables tc explain success on recruiting duty are 
generated by the author based on a reading of the 
itjeerature. Theories to support specific hypotheses on 
recruiter success are in limited supply. It is anticipated 
that recruiters who finished high school and those with 
above average AFQT scores, because these are possible 
Miercators Ci ability, wiil be more likely to be successful 
on recruiting duty. Also, individuals who are single with 
Seeetoren Or married with more than two children are 
expected to have higher levels of family-related stress. 
This stress may carry over into the working environment, 
Meme, cecreasing a recruiter’s productivity. Finally, the 
Navy Counselors (MOSi1) are expected to possess the highest 
probability of SuCCeSS, followed by Che 4shieleul 


administrative types of individuals. 


C. STATISTICAL TECHNIQUES 

This sample of recruiters is first examined using 
descriptive statistics. Frequency analysis is conducted to 
@eeertbe the individual characteristics of the recruiters, 
including RSTB scores and biodemographic ee ess One 
Sreeede Purposes of this research is to either support or 


discount previous validation studies of the RSTB. To make 


comparisons, then, cross tabulations between production and 
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RSTB scores are developed. The RSTB scores are separated 
into quintiles. Production is divided into the upper 50th 
and lower 5Gen percentiles. Additionally, cree 
tabulations are conducted with RSTB scores also separated 
into the upper 50th and lower 50th percentiles. 

. Bivariate Pearson product-moment correlations are 
computed fOr Puree ters comparison of eacn facteme 
Multivariate regression analysis is also used to determine 
the impact eis the RSTB scores, combined with the 
biodemographic variables, on productivity and success, ia 
reasoning behind this is that modelling recruiter success 
seems to be a natural progression from techniques 
previcusiy described, especially with the data already 
COUMeC cee If this leads to meaningful results, thenwew. 
knowledge base (which appears to be limited) to describe 
recruiter behavior is expandec. 


For production as a continuous variable, estimation 1s 


accomplished using Crdinary Least Squares (OLS) estimating 
techniques. When success, aS generated from production, 
becomes a4 binary variable, the logistic Yregcressiem 
procedure 1s utilizea: 


The logistic procedure employs the maximum likelihood 
estimating technique which is more suited to tae 
distributions expected from using a dichotomous dependent 
variable. Two models are examined uSing each technique. 
One model includes the recruiter composite percentile score 


on the RSTB, with the biodemographic variables chosen eo 


explain succesS/productivity. The other model utilizes the 
four raw Subscale scores. A sample description and all 
statistical results are presented and discussed in greater 


@eear) inp Chapter IV. 
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IV. ANALYSIS AND RESULTS 


A. SAMPLE DESCRIPTION 

Frequency analysis is used to describe the char- 
acteristics of the 236 recruiters in thveeeaenou Table 3 
displays the biodemographic attributes of the sample. As 
could be expected, the majority of the sample has some type 
of high school diploma, since the Navy prefers to recruit 
individuals with that credential. Another interesting 
aspect of this sample is the large number of married 
individuals with two or more Garlaren. In addition ame 
average age of the recruiters is 31 years old. The 
recruiters appear to be distributed among the six different 
recruiting regions fairiy evenly. 

Table 4 provides a description of these recruiters’ 


human relations skills, selling skills, organizing Skwiee 


overall performance, and recruiter potential composite 
percentile (RECPCNT) scores on the RSTB. The RSTB subscale 
scores us€éa in this thesis are raw scores generated from 
the scoring machine at Headquarters, Marine Corps. 


Negative scores are possible because points are taken awav 


in the scoring for certain types of answers on questions of 


the SRS s The recruiters’ scores are separated into 
quintiles. These quintiles are used for much of the 
following analyses. The recuiters’ RSTB scores appear to 


closely fit the shape of a normal distribution. 
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TABLE 3 


BUSODEMOGRAPHI GVGHARACTERISTICS OF RECRUITERS 


Percent 
SiaracteriStic Frequency of Sample 
Upper AFOT Category gga TO 
Lower AFOT Category Se) 20 
Age: 
we 25 20 24 
mos 30 55 2 ee, 
eae 35 65 IRS 
36-40 a6 ie. 
41-48 14 6 
Marital/Dependents 
Sea cus > 
Single 22 9 
Single with dep. 12 S 
‘Married 47 20 
Married with 1 child 42 18 
Married with 2 or 
more children Tee 48 
High School Graduate 218 92 
Pem-Hign School Grad. i8 8 
White 19? eo 
Minority 39 ieee 
MOS 3 
Navy Counselor ible 7 
Administrative 1¢ S 
Specialist 48 20 
Repairer eas 65 
Recruiting Area: 
Areal a 24 
Areas 24 18, 
Area4 45 1g) 
Aread 5) A eee. 
Area? C2 14 
Area&g ae age 
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TABLE 4 
RECRUITERS’ PERFORMANCE ON RSTB AND PRODUCTION IN THE FIELD 


Percent Standard 
Range Frequency of Sample Mean Deviation 


RSTB Scores: 


Human Rela- 


Gvons Skies reno4 6.99 
(HRRAW): -1- 7 uz 7 
8-14 54 23 
1 SUE oe Oe, 
Zee ee 54 25 
29 = 30 ine 8 
Selling 
Sih ui 
(SSRAW): 15.07 656m 
=A tis 6 
4=—10 4} Leh 
(IE ay, Be ee) 
1S cara. te See 
Zo oo LG 7 
OpCa na fae 
Sik tans 
(OSRAW): 16528 5.98 
Sao 4 4 a 
a 10 36 is 
eee 104 44 
18-24 66 23 
Zoo Zo a 


™ - VY 3 
a 
OEE So tie va ime 


Performance 


(OPRAW): 18.26 7.40 
—4- 4 § 3 
5-12 46 26 
13-20 SE 36 
21-28 70 30 
29-36 26 al 


TABEE wd (cont. } 


RoenRudenS —PERPORMANCE ON RSTB AND PRODUCTION IN THE FIELD 


Percent Standard 
Range Frequency of Sample Mean Deviation 


Composite Re- 
Sruacer Poten= 
tial Score Per- 


centiles 
eeecPCNT): O20 1G 1a 
iro—2 7 10 “ 
28-43 oe 16 
4L=59 ee ao 
SOI o6 al ots! 
a ais il 28 ne 
Beverage Year- 
iaeeroduction 
Pees s Is. 9 Bos 
Je 3 ame 5%, 24 
Oo Sele an 26 
19.328 358 77 ce 
Pid use eae be 34 14 
No WoW Gato ane We 7 3 


Number (Percent) Success- 
mpeee. Or Production >= 
a7 20: Hh 49% 


Number (Percent) Not 
Successful at Produc- 
feet >= 18/20: eZ Slee 


Number (Percent) Success- 

Meme Cr Production >= 30: 29 sarees 
Number (Percent) Not 

Successful at Production 

>= 30: oe 83% 
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Table 4 also shows a breakdown of the productivity of 
the recruiters in the sample and their corresponding levels 
of success. Success at the lower level of production is 
defined as the recruiter having at least 18 new contracts 
per year, if he or she was productive only in fiscal 
and 1984. If the recruiter was productive during fyoeam 
1983, 1984, and 1985 then he or she is considered suc- 


cessful when productivity is 20 or more contracts per year. 


B. CROSS TABULATION ANALYSIS 

Cross tabulations provide information cConcerninomes. 
recruiters’ performance on recruiting duty relative to 
their performance on the RSTB. Figure 4.1 shows these 
results. This figure indicates, for example, that 63 
percent of the recruiters scoring in the upper 20th 
‘percentile of the selling skills subscale were successful, 
compared to 53 percent of these scoring in the lowest 20th 
percentile. Success in this instance is defined as 
recruiters with producticn rates in the upper half of all 
Production: 

A comparison between the results of this cross tabula- 
tion and the results presented by the Borman et al. 
validation study of 1981 reveals that Borman et al. 
expected individuals who scored poorly on the subscales of 
the RSTB to also have less success on recruiting duty [Ref. 
3]. Figure 4.1 suggests that this expectation doesiags 
carry over to this sample of recruiters. Those individuals 
who scorea in the top, middle, and lowest levels on the 
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human relations skills had equal instances of success. 
Within the selling skills subscale, recruiters scoring in 
the highest quintile had the most success; however, those 
scoring in the lowest 20th percentile performed better than 
did those in the next two higher quintiles. 

Individuals who scored in the top level of organizing 
skills had the lowest occurrences of success of all 
recruiters in the sample. Conversely, those who scored in 
the lowest quintile had the highest level of success. This 
result, in particular, 1S in direct contrast to what was 
predicted in the 1981 validation. However, this result may 
be attributable to sample effects. As shown in Table 4, 
only four people in the sample scored in the lowest 
quintile on selling skills. Because of this, the cross 
tabulation between the lowest performers on selling skills 
and productivity may not be representative and, therefore, 
may be misleading. 

Overall performance and RECPCNT scores also have fairly 
eratic associations with success. Overall performance is 
the only subscale where recruiters scoring in the lowest 
quintile have the least occurrence of success. However, 
the opposite cannot be said of those scoring in the highest 
quintile of this RSTB subscale. One consistency to be seen 
from Figure 4.1 is that in three of the five subscales, the 
middle scoring group of recruiters had the lowest ¥oe- 


currences of success. In the two other categories of 


a2 


performance on the RSTB, the middle group’s success rate is 
in the middle. 

Cross tabulations between recruiters’ RSTB scores 
separated into upper and lower 50th percentiles and 
recruiters’ productivity separated into upper and lower 
50th percentiles reveal a pattern that is somewhat more 
consistent with previous validation studies. Figure 4.2 
shows, that, for example, of those recruiters who scored in 
the upper 50th percentile on the overall performance 
Subscale, 57 percent were in the upper 50th percentile on 
production. Only 43 percent of those scoring in the lower 
half of the overall performance category were successful. 

Chi-square tests of homogeneity or independence between 
the levels of success show that only the difference between 
the upper and lower scores on the overall performance 
Subscale 1s statistically significant at .05. All other 
differences in performance on the RSTB are insignificant at 
levels of .30 or more. Thus, even though there are 
differences between the hecmumrers i oreductivity in 
relation to how they score on the RSTB' subscales, the 
majority of these differences mean very little. 

Another way to examine these recruiters’ performance on 
the RSTB relative to their production is to look at average 
levels of productivity. Figure 4.3 presents thesé results, 
which are useful for comparison to the United States Marine 
Corps (USMC) validation of 1986. [Ref. 4} The results from 


that study led the researchers to conclude that "Marines 
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whose Special Assignment Battery (the RSTB equivalent) 
scores fell in the lowest 20 percent consistently performed 
at significantly lower levels that higher scoring sub- 
FECtsS: 4 

Figure 4.3 shows that recruiters whose RECPCNT score 
was in the upper 20 percent had levels of productivity that 
were higher than the recruiters scoring in the next two 
lower guintiles. However, recruiters scoring in the lowest 
quintile of the RECPCNT scores had the highest average 


yearly productivity of any group. 


C. CORRELATION ANALYSIS 

Further examination of the relationships between RSTB 
scores of this sample and average yearly production rates 
using Pearson product-moment correlations 1s presented in 
Table 5. Also presented here are the correlation results 
reported in the development validation study of 1981 and 
the two USMC validations published in 1986 [Ref. 3 and Ref. 
o 4) 

The correlations from this current research are very 
different from those of the previous studies. In fact, the 
most highly correlated subscale with production is the 
selling skills score of the recruiters at the level of 
10S This is also the score with the highest level of 
Significance. However, a significance level of .18 does 
not indicate a very strong relationship. Negative cor- 
relations between production and the human relations and 
organizing skills indicate that as these scores increase, 


5G 


TABLE 5 


COMPARISON OF CORRELATIONS BETWEEN PRODUCTION® 
AND RSTB SCORES 


RSTB Development USMC USMC 
Validatwon Study Concurrent Predictive 
Study 1989 1981 Study 1986 Study 1986 
(n=236) (n=194) (n=1005) GaH=315) 
Prmeaictor (Skill) 
Human 
Relations -.013 2s 5 a Aus’ 
Level of 
519. p= .84 oe. ere pee 204 Ses 5 Ou 
Selling .087 ee 223 eS 
Level of 
Sle p= .18 Se ame Ba 2. O01 oes TiO) 
Organizing = eel 13 1) 209 
Level of 
= . p= .98 NA BES pOS NA 
Overall 
Perform. BORGES: SPAS: ead ~24 
Level of 
Sue. = 2255 Dd. = won O00 1. bea. O | 
Reeruiter 
Composite wales 5 Os mee me) 
Level of 
et . p= .56 oe Ona pe OOr oa ee Al 


“production in 1989 Validation = Average Yearly Contracts 
Production in 1981 and 1986 Validations = Average Monthly 
Someracts 


fewe— Not Available 
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productivity falls. However, the levels of significance on 
these two results show that they cannot be relied on for 
ACCURAG aE 

Additional correlation analysis was conducted using the 
biodemographic variables provided for these recruiters. 
The purpose of this analysis is to compare the relationship 
of the biodemographic variables with productivity against 
the relationship of the RSTB scores with productivity. 
This may provide further insight into recruiter ipa 
Guctivity and success. It may also reveal whether or not 
biodemographic variables can be used to select recruiters 
who will succeed in conjunction with or in place of RSTB 
scores. Table 6 shows the results of this correlation 
analysis. 

Not surprisingly, AFQT score of the individual has the 
‘strongest and most significant correlation with pro- 
QuUGHin Tey. What iS Surprising is that the correlation is 
negative--the reverse of what was expected. There may be 
two. explanatvons tor emeutce First, a cross tabulatien 
between the AFQT upper and lower 50th percentiles and 
productivity, as shown in Table 7, reveals that more 
recruiters (by percentage) with below average AFQT scores 
had production rates in the upper 50th percentile than 
those with above average AFQT scores. Therefore, the 


negative relationship is expected, given the sample data. 


De 


EAB Eas 


PEARSON CORRELATION COEFFICIENTS BETWEEN BIODEMOGRAPHIC 
VARIABLES AND AVERAGE YEARLY PRODUCTION OF THE 


RECRUITERS 
Variable Correlation Coefficient Level of Significance 
AFOT -.233"° .001 
AGE -.076 £25 
SINGLE .040 £54 
MARRIED -.009 .89 
MARIKID -.099 ie 
MAR2KID .060 36 
HS -.026 .69 
WHITE -.146° 02 
MOS1 .175° yO07 
MOS2 -.015 .82 
MOS3 “Sons 85 
AREA1 = eo + .05 
AREA3 -.008 89 
AREA4 .044 50 
AREAS Roe £75 
AREAS .185° .004 
a 


Indicates significance at .10 level or better. 


oe 


TAB Eee? 


PERCENT OF RECRUITERS WITH ABOVE AND BELOW AVERAGE 
PRODUCTION LEVELS BY AFOT PERCENT Mite ee. 
(ABOVE OR BELOW 5SOTH PERCENTILE) 


Production 
AFOT Score Lower 50 Percent Upper 50 Percent 
Below 50th Percentile aD20 67.80 
Above 50th Percentile 54.80 45.20 


A deeper explanation for this negative relationship may 
stem from a policy change enacted around June 1983. [Ref. 
28] According to Navy Recruiting Command, in mid-1983, 
Congress mandated a cut in end-strength of the Navy’s 
enlisted force. To accomplish this, accession goals were 
cut dramatically. Therefore, those recruiting districts 
that had either met or were approaching the reduced goals 
either stopped recruiting altogether or proceeded to build 
up membership in the Delayed Entry Program (DEP). It is 
speculated that in these districts, those (high AFOQOT) 
recruiters who had met their individual recruiting Goo 
Slacked off, either intentionally or unitentionally. This 
allowed those (low AFOQT) recruiters who may have had 
difficulty meeting goals during highly competitive periods 
to attain their recruiting goals as well. The effects of 
this may have carried over as far aS mid-1984 because of 
the built-up DEP, the decreased pressure of competition 
within individual recruiting commands, and the continuing 
relatively high levels of unemployment. This would have 
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artificially inflated the recruiters’ production rates 
within this sample. 

Other significant results from EMrSecorre lation 
analysis are the negative relationships between white 
recruiters and production and between AREA1 and production. 
This AREAl result 1S also somewhat unexpected. The area 
variables were constructed so that the area with the lowest 
averages in recruiting productivity during fiscal 1983, 
1984, and 1985 was the base case variable (AREA7). 
Therefore, all other areaS were expected to have positive 
relationships with production rates. The basis for this 
WEE provided inthe PRIDE data from the Center for Naval 
Analyses. Table 8 presents the production and unemployment 
rates for each area, by fiscal year. The consistently low 
unemployment rates in AREA1 coupled with the dramatic drop 
in average production in fiscal 1985 may account for the 
negative correlation between AREAI1 and productivity. 

As anticipated, MOSI1 (Navy Counselors) is positively 
and significantly related to productivity. Marital status 
has little or no relationship with production rates. One 
interesting result to note is the positive (although, 
insignificant) relationship between individuals with two or 
more children and productivity. Perhaps, 1f this group 
were further separated into categories of recruiters with 
two children, recruiters with three children, and so on, 
the correlation would be more meaningful. As it is now, 


this positive relationship indicates that the hypothesized 


oul 


TABLE 8 


PRODUCTION AND UNEMPLOYMENT RATES FOR EACH 
RECRUITING AREA BY FISCAL YEAR 


AREA] AREA3 AREA4 AREAS AREA? AREAS 


Fiscal 1983: 


TotadeGon— 

tracts 12,275 11,480 11,827 U2, 16c5 ee 10 ,came 
Number of 

Recruiters 665 Soul 590 662 559 588 
AVerage. ce. 

Cuece pom digs wea\S) Jigen 3 2070s Le. 3a ee lege Ve" 
Unemployment® 8.48 9.84 12.17 10.5200 10.50 


Fiscal 1984: 


Total Con- 

tracts 10,921 107993 21215) 1 eee 8,677 10,4738 
Number of 

Recruiters ayer | 618 548 590 Bon 54k 
Average Pro- 

Gue tile ai8-73 L766 20347 18.91 16.98 19 7324 
Unemployment’ 6.57 234 977s o.. Oe 7 ea S UG 


Fiscal 1985: 


Totak Cone 

tracts 10,478 11,571. 10> 743 ieee Sin F031); ll /2ee 
Number of 

Recrui Gems 607 642 558 622 sis) & 592 
AVerage eros 

aguction atO.77 Hers) 5 (0) 2 19.26 Loe 18235 19.06 
Unemployment 5.77 6.61 S.ow ee (ee 5S 7. ow 


“nn 


Average Unemployment per Area = 


Sum(Unemployment for Navy Recruit. Districts (NRD) in Area) 


Number of NRDs in Area 
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increased family-related stress plays no part ina re- 
cruiters’ level of productivity. 

Correlations between the variables, excluding pro- 
duction rates, reveal three more relationships that are 
worthy of note. First, white recruiters and recruiters 
scoring in the upper 50th percentile on the AFOQT have a 
@emrelation of .56 (p < .001). Second, each of the RSTB 
subscales are intercorrelated. These correlations range 
from .38 between selling and organizing skills to .80 
between selling skills and overall performance. All of the 
relationships are Significant at p < .00o1. This is 
actually a good sign from one perspective--recruiters who 
Pemrorm well on one aSpect of the test battery also perform 
well on other portions, and vice versa. 

Finally, the marital/dependents status variables are 
meecorrelated at levels ranging from .23 to .48 (p< 
= O16 ta ae This is to be expected, given the way these 
Variables were constructed. These correlations, between 
potential explanatory variables, may create some diffi- 
culties when interpreting effects of the variables on 
Pe@GuetiVity/SuUuCCeSS on recruiting duty in the following 


multivariate models. 


D. MULTIVARIATE REGRESSTON ANALYSIS 
1. Ordinary Least Squares (OLS) Regressions a 
The first two models discussed in this section are 
estimated using the method of OLS regression. The depend- 
ent variable is the recruiters’ average yearly number of 


6s 


contracts (production races jm These models assume linear 
relationships between the continuous dependent variable and 
the explanatory variables. Table G shows the estimation 
results of Model 1. This model contains the recruiter 
potential composite percentile score as one of the ex- 
planatory variables. Model 2, in contrast, uses the RSTB 
subscale scores. 

In these constant slope models, elasticities can be 
computed for the continuous variables. Each elasticity is 
calculated using the mean values of both the explanatory 
variables and the production rate. The interpretation of 
the elasticities of the continuous variables in Model 1 is 
as follows: 

a. For every one percent rise in an individual’s 
RECPCNT score, the production rate 1S expected to 
Increase .006 percent. 

b. For every one percent increase in an individual’s 
AGE, there will be a resulting .38 percent decrease 
Ae tete OOUCTE AY 1 iteiae 

The estimated model shows that first, there are 
only four variables in it that have a statistically 
significant impact on recruiter preducci@ee lth ia 
individual scores in the upper 50th percentile on the AFOT, 
there is a significant, but negative effect on production 


rates. A one year increase in a recruiter’s AGE leads to a 


.23 decrease in average production per year. Being a Navy 
Counselor (MOS1) indicates that productivity will increase 
by 7.26 average contracts per year. Finally, recruiting in 
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TABLE 9 


OLSS@BEGRESS ON) MODEL i 
(DEPENDENT VARIABLE = AVERAGE YEARLY CONTRACTS WRITTEN ) 


Variable Coefficient (T=Statvwscere7 P 
RECPCNT .002 .06 £95 
AFOT 4-7 2.54 .01 
AGE = .264 1678 MOT 
SINGLE . 88 .24 .91 
MARRIED - .46 syilses 89 
MARIKID -1.48 £45 65 
MAR2KID 53 Rig . 86 
HS - .82 124 Poe 
WHITE -1.01 245 .65 
MOS1 jee = 2.66 O1 
MOS2 1.60 .63 53 
AREA1 - .26 615 .88 
AREA3 ~1.06 .46 .64 
AREA4 we .45 .65 
AREAS 1.80 275 .46 
AREAS ao 236 Moy 
- Semwenificant at p < .10 

Adjusted R* = .08 

MeeacisScic = 2.22 Prob. = .005 

Number of Observations = 236 

Mean Square Error = 97.04 
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AREA&8 leads to the greatest influence on average yearly 
preoducmuen . 

Although RECPCNT scores are not significant in this 
model, they have a small positive effect on recruiter 
PROCUCEI ae. Marital status results are primarily as 
expected. Being single leads to a positive effect on 
productivity and being married with one child influences 
recruiter production rates more negatively than does simply 
being married. The surprising result is that being married 
with two or more children apparently does not affect 
productivity negatively. This result is consistent with 
the correlation analysis results. The MAR2KID variable 
coefficient is not significant, so this result may be 
entirely misleading. Being white and a high school 
graduate both have negative impacts on recruiter pro- 
ductivity, but again, these are not significant “esulees 
High school graduation may have little bearing on pro- 
duction rates inthis thesis because recruiters who have 
been selected for recruiting duty and to the pay grade of 
at least E-5 probably have attained some equivalency of the 
hich school ai eilema. By this time in the recruiter’s 
career, whether or not the individual completed high school 
may be irrelevant. 

As expected, the coefficient for the strictly 
administrative occupational specialties (MOS2) is positive 
and the specialist’s (MOS3) coefficient is negative. 


Finally, as was seen in the correlation analysis, re- 
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cruiting in AREA1 has a negative influence on production 
rates, while all other areas have positive effects. 
Unfortunately, the majority of these results are in- 
Slcmiticant. 

Recruiter characteristics which have significant 
effects on productivity in Model 1 are AFOQT score, the Navy 
Counselor occupation (MOS1), and recruiting in AREA8. The 
negative impact of scoring above average on the AFOQT is, 
again, interesting. The explanation for this may be 
Seseribed as the artificial inflation of recruiter pre- 
ductivity, which was discussed above. Another reason that 
Being in the upper 50th percentile of the AFQT scores has a 
negative impact may be that individuals who score high on 
the AFQOT may be better suited for other work--they simply 
may not make good recruiters. 

Based on the production and unemployment rates 
shown in Table 8, it was anticipated that recruiting in 
AREA4 would have the greatest impact on recruiter pro-~ 
ductivity. This is not the case; however, AREA4 does have 
the second largest effect. The explanation for this is 
unclear. 

Table 10 presents the results for the second 
multivariate regression model using the average yearly 
contracts obtained by the recruiters (production rates) as 
the continuous dependent variable. Substituting the RSTB 
subscale scores for the recruiter potential composite score 


2 


does little to improve Model 2. The adjusted R°~ for both 
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TABLE 10 


OLS REGRESS@@N MODE 
(DEPENDENT VARIABLE = AVERAGE YEARLY CONTRACTS WRITTEN ) 


Variable Coefficient /T-Statistic/ P 
HRRAW Seat: 1 2) ae 
SSRAW .16 293 .35 
OSRAW wtih Bayi 4am 
OPRAW - .05 WAS .81 
AFOT - 4.45% 2.36 Oe 
AGE ee 6S 1.93 .05 
SINGLE SE a0 .76 
MARRIED .14 .04 .97 
MARIKID - 1.29 .38 .70 
MAR2KID .79 .25 80 
HS - 1.13 .44 66 
WHITE - 1.33 . 60 255 
MOS1 20 Dae Ou 
MOS2 1.96 .76 .45 
MOS3 S17 Bit. .92 
AREA1 - .69 .29 Te 
AREA3 1.29 247 .64 
AREA4 Deals .88 .38 
AREAS 1.64 .67 50 
AREAS 6.79% 2.54 vom 
4 Sigmar] cant Gate omc ard) 

Adjusted eo = .08 

F-Statistic = 2.00 Prob. = .008 

Number of Observations = 236 

Mean SQUa@PC SR eon (e727 
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models are identical and the low value (.08) suggests that 
the amount of variation in productivity explained by the 
models’ variables is minimal--the models do not predict 
productivity very well. 

The same explanatory variables are significant in 
both models and each variables’ relative impact remains the 
same, with one minor exception. The variable constructed 
for married recruiters has gone from being negative in 
Model 1 to having a positive sign in Model 2. However, it 
remains inSignificant in Model 2, suggesting no real 
influence on production rates. 

Elasticities of the RSTB subscale variables, 
computed at their mean values, Suggest the following: 

a. For every one percent increase in the human 
relations skills score, there is a resulting .17 
percent decrease in productivity. 


b. For every one percent rise in the selling skills 
score, production rates increase .13 percent. 


c. A one percent increase in the organizing skills 
score indicates a .09 percent increase in pro- 
SauSeryi ty" 
ad. For every one percent increase in the overall 
performance score, productivity decreases approx- 
imately .05 percent. 
The negative impacts of the HRRAW and OPRAW 
Variables are insignificant, and yet, unexpected. Model 2 
: | | “t 
predicts that if recruiters score low on these subscales of 


the RSTB, their productivity will be higher than those who 


score well. This is totally inconsistent with the hypo- 
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thesis that the RSTB can be used to predict recruiter 
SUCCESS. 
2. Logistic Regressions 

There are four models presented in this section 
using the logistic regression method of estimating coef- 
ficients. _The four models are organized in such a jwayeee 
to allow for comparisons between the two levels of success 
as the dependent variable and like explanatory variables. 
Success is defined aS a binary variable. Success equals 
one when a recruiter produced 18 contracts per year, if he 
or she wasS on recruiting duty only in fiscal 1983 and eae 
If the recruiter remained on recruiting duty from fiseam 
1983 to 1985, then he or she is considered successful if 20 
or more contracts per year were obtained. The logist#e 
regression, using the maximum likelihood method to estimate 
‘the coefficients, is particularly useful in this analysis 
because success iS a dichotomous variable that describes 
behavior on a Mmasero levels {Repu This method of 
regression suggests that the expected outcome of the logit 
model--probability of success--can be represented by the 


following equation: 


P Saye e7 (Sum(Bix1) 
where: P = Probability of Success 
e = Natural Log 
Sum(Bixi) = Sum of the estimated coefficients from the 


models multiplied by assumed values of 
the explanatory variables. 
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Table 11 provides estimation results of Model 3 and Model 
4. 

In Model 3 of the logistic regression, three 
variables were found to have a Significant impact on 
success. Again, scoring in the upper 50th percentile on 
the AFQT has a negative effect on success, as does AGE. 
Also, the Navy Counselor MOS contributes positively to the 
prediction of success. In fact, in comparing results 
between Models 3 and 4 with their varying levels of 
success, the Navy Counselor variable impact is the only 
consistent result. AREA8 has a Significant, positive 
effect in Model 4. All other variables in this second 
model have insignificant results. 

Interestingly, RECPCNT acquires a negative sign 
when success is defined more stringently. However, 
recruiting in AREA1 changes to a positive influence on 
success. Other reversals in coefficient signs, as a result 
of the change in the criteria for success, indicate that 
being Single, being married, or being married with two or 
more children all have negative effects in Model 4. High 
school graduation no longer has a positive impact in Model 
Ag Finally, the repairers now have the lowest impact on 
success, contrasted with the specialists (MOS3) of the 
previous models. 

To evaluate the specific impact of each variable on 
these models, partial effects are computed. With the 


logistic regression, these effects are interpreted as 


aol 


TAB@E i 


LOGISTIC REGRESSION RESULTS FOR MODEL 3 ANDSMODEIA@ 


Model 3 Model 4 

Success = Production ey Success = Production 

> = 18" Or' 20 Contraces > = 30 Contracts 
Variable Coef. CHI? Pp Coef. CHI’ Pp 
RECPCNL aa) Dal: SIGS! SMe =. OS ake ll ~44 
AFOT SmI Bo oe Oe ae 1.96 .16 
AGE = 05? ee Gis. - .04 dee Pees) 
SINGLE ~ 24 S20 s/o = 47 24 aso 
MARRIED Edits: 0) 7 Aoi Se ee oF! Pro rit 
MARIKID = fi -46 aod = (62 Ow ~43 
MAR2KID 720 ele, Le = S66 me: Ao 
HS -46 mee I - 40 ee 1.14 Zi 
WHITE ee EES one = s3).4 0 9S 
MOS1i pee su 5 ~05 ieee 3266 Aad) s: 
MOS 2 a) se ~o6 Moe. oo Bes 
MOSS ee Laem ee see sabes) 0) ~48 
AREAI Sere Os, #03 ~o5 = 64 oe nS. 
AREA3 -08 eZ Ries: £8) 3 idea 228 
AREA4 ~44 Bas SS) O38 i725 so 
AREA5 Ore SS, us Bes, 206 soile 
AREA8 m2 8. 1.46 Ap Leeann 4265 ORs 


“ contracts expected per year of recruiters on recruiting 
duty for fiscal 1983 and 1984 = 18. Contracts expected pen 
year of recruiters on recruiting duty through fiscal 1985 = 
Zr 


e Significant at .10 level or betrerm 
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TAn ieee Cont .} 


LOGISTIC REGRESSION RESULTS FOR MODEL 3 AND MODEL 4 








@rassification Table of Classification Table of 
Model 3 Predictive Model 4 Predictive 
ATi ity ADTLEecy 
Predicted Predicted 
Neg. Pos. ete aad Neg. etm Meneses 
Neg. 88 33 1. Neg. 195 2 197 
True Tee 
Pos. 46 69 eae Pos. 34 5 39 
motal 134 Or. 236 Total 229 , 236 
@verall Prediction Rate: Overall Prediction Rate: 
S65 % or, eae Bes 
False Neg. Rate: 34.3% False Neg. Rate: 14.8% 
False Pos. Rate: 6) is False Pos. Rate: 28.6% 
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increases or decreases in the probability of success, given 
certain values for the variables being examined. In 
addition, the base case scenario for these models was 
Constructed so that “teapeconsists Yor re recruiter char- 
acteristics that are expected to have the most negative 
impacts on success. Thus, the base case includes those 
recruiters scoring in the lower 50th percentile on the AFOT 
who are single with dependents, non-high school graduates, 
minorities, with a repairer-type MOS, recruiting in AREA7. 
Given the results of Model 3, the probability of success 
for the recruiter with base case characteristics, the 
average RECPCNT score, and the average age is 54 percent. 
This percentage is generated by inputting the estimated 
coefficients into the logit equation and solving for the 
probability of success. 

Table 12 displays the independent partial effects 


for the variables having significant influences on success. 


TABLE EZ 


PARTIAL EFFECTS OF AFOT, AGE, MOS] ON SUCCESS @inN "Gn ee 


Explanatory Variable Calculated Probability of Success 
(Percent) 

Above average AFOT score 32 

Average AGE less one yr. a7 

MOS1 (Navy Counselor) 80 


The base case scenario for Model 4 remains the 
same. Evaluation of the recruiters in the base case with 
the higher level of productivity determining success 
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reveals that they have a 39 percent probability of success. 
Navy Counselor (MOS1) recruiters in this model, compared to 
Model 3, have a slightly reduced probability of success at 
71 percent. Finally, AREAS recruiters with the same base 
case qualities have a likelihood of being successful of 77 
Peiseent . 

The classification tables reveal that the correctly 
predicted rates of success are quite high. This suggests 
that, even though the level of significance on the indi- 
Vidual explanatory variables is low, the overall models fit 
the data rather well. 

Two additional logit models, providing results for 
the RSTB subscale scores as explanatory variables, are 
presented in Table 13. The dependent variables--"success"- 
-are defined in the same manner aS in Models 3 and 4. 

Results in Model 5 are basically the same as those 
in Model 3. AFOT score and AGE negatively affect success, 
when success is defined as production rates greater than 18 
ieee 6CcOontracts per year. The substitution of the RSTB 
subscale scores for the recruiter composite score does not 
improve the explanatory power of this model. None of the 
test scores have a statistically significant impact on 
Success. As in the correlation analysis, human relations 
skills scores appear to have negative inflwences on 
success, while all other scores are positive. 

An evaluation of this model with the RSTB scores 


set to their mean values, reveals that the probability of 


Ts 


TABLE als3 


LOGISTIC REGRESSION RESULTS FOR MODEL @Se4ipeO>R 


Model 5 Model 6 
Success = Production 7 Success = Production 
> = TS" or 20° COn@a@aees > = 30" CCreraccrs 
Variable Coef. CHI? P Coef. CHI? P 
HRRAW =e. 0'z + Sali uO 2 =- 07> 2.565 a AIG. 
SSRAW BOO O 9. .08 2usuly ~14 
OSRAW iz sas ste ll Oe: eli 27.0 
OPRAW 007 08 206 Ses ~45 10 
MARRIED cole Ors: Bs: ee ot ~40 ao 
MARIKID aut () si) 48 se 49 29 pays) 
MAR2KID weed: e140 ho "oS iO -48 
HS ~45 2on ~-41 =. 56 Lasse 2a 
WHITE eet a6 mba" = ae see eas: 
~ MOS1 1.30” 3385 205 1.25" See O77 
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¢ contracts expected per year of recruiters on recruiting 
duty for fiscal 1983 and 1984 = 18. Contracts expected per 
year of recruiters on recruiting duty through fiscal 1985 = 
20s 


2 Significant at .10 level or better. 
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LOGISTIC REGRESSION RESULTS FOR MODEL 5 AND MODEL 6 


G@llassification Table of 
Model 5 Predictive 


Ability 





Syerall Prediction Rate: 


So.7% 
False Neg. 


False Pos. 


Predicted 

Neg. Pos. 
86 oS 
46 og 
lS 104 


Rate: 


Rate: 


34.8% 


CV RW Re: 


Total 


eZ 


Ja ie: 


2.5.0 
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Gassification Table of 
Model 6 Predictive 





Ability 
Predicted 
Neg. POs eehecal 
Neco. Jt e 4 sigh a 
[rue 
Pos. Se, 7 29 
Gres) eee) a 236 


Overall Prediction Rate: 
oar 7 2 


False Neg. Rate: 14.2% 


False Pos. Rate: 36.43 


Success for recruiters with the base case attributes is 59 
percent. Partial effects from the significant variables in 
this model are virtually identical to the Model 3 results, 
because of the similarity in the magnitude of the estimated 
coefficients of the explanatory variables. 

An interesting outcome in Model 6, where the 
criteria for success is higher, is that human relations 
Skills scores develop a_ significant influence on success; 
however, this relationship is negative. Selling skills 
scores are Significant at the .14 level in this sixth 
model, which iS more consistent with expected results. 
Again, aS occurred between Models 3 and 4, AGE and AFQT 
score are no longer Significant contributors to success at 
the higher level of productivity. The variable for Navy 
Counselors (MOS1) remains positive and significant. 
Recruiting in AREA8, once again, becomes significant and 
contributes the most to Model 6. 

The degree of similarily between Models 3 and 5 and 
between Models 4 and 6 indicates that it does not matter 
whether the RSTB’s composite recruiter potential score or 
the RSTB subscale scores are used. The effects of bogs 
test score results are negligible in the logistic regres- 
Sion models. 

The changes observed from modifying the criteria 
for recruiter success do not necessarily represent an 
improvement of one model’s predictive ability over the 


others. When the criteria for success are higher, the 
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occupational specialties influence success as expected. 
However, high school graduation has a negative effect on 
Success, which was not anticipated. The variables SINGLE, 
MARRIED, and MAR2KID have a negative sign, whereas at the 
lower level of success they were positive. Each variable 
maintains its insignificant influence on success, so these 
changes mean virtually nothing. 
3. General Comments 

There are some general consistencies throughout all 
Six models that deserve some attention here. Porrst, 
scoring in the upper 50th percentile on the AFOT has a 
Pesative impact on production and success in all models. 
This result was not expected. However, the reduction of 
accession goals and the positive economic conditions for 
the recruiters in this sample certainly played some part in 
this outcome. Since it 1S also possible that this result 
truly indicates that lower scores on the AFQT may be 
related to success on recruiting duty, further assessment 
of this relationship could reveal implications for the 
recruiter selection process. 

Second, older recruiters’ potential for success, as 
indicated in each model, is lower than the potential for 
younger recruiters. It is possible that older recruiters 
(the Senior and Master Chiefs) are completing a "twilight" 
tour at a recruiting district in preparation for retire- 
ment. Thus, success on recruiting duty may not be a 


primary concern for these older recruiters. ILigh Silo pl eneygy 


WAS 


senior recruiters are more likely to be the Leading Petty 
Officers or Supervisors of the recrulEing Sertirce. 1). 
added duties may reduce their productivity, with respect to 
obtalnmwng recruiltwe@ontracte. 

Third, being white, in every model, resulted ina 
negative impact on production or success. This outcome may 
be attributed to the limited variation in the sample with 
respect to this variable--only 39 recruiters (17 percent) 
were minorities. A second possibility is that if minority 
recruiters are more likely to be stationed in Navy 
Recruiting Districts with higher minority populations, 
their recruiting productivity may be venhanceda 

The Navy Counselor MOS is consistently significant 
and the largest contributor, of all the MOSs, to production 
and success. This result was entirely expected. What 
wasn’t expected was the negative effects of AREA1 and the 


large, poSitive impacts of recruiting in AREA8. 


80 


V. CONCLUSIONS AND RECOMMENDATIONS 


Recruiter losses from recruiting duty can cost the Navy 
Substantial amounts of permanent change of station, 
temporary additional duty, and training dollars. Losses 
partially occur as a result of a recruiter’s inability to 
consistently attain the enlistment contract goals imposed 
by Navy Recruiting Command. A lack of Success at 
recruiting duty may affect a recruiter’s outlook on the 
Navy and may result in lower morale and, possibly, a 
premature conclusion to his or her Navy career. These 
costs may be avoidable, to some extent, 1f a method could 
be divised to identify and select individuals who have a 
greater likelihood of success on recruiting duty. 

Many methods of determining recruiter success have been 
extensively researched. The literature review section of 
this thesis examined a number of them. Some of the methods 
used in previous studies to evaluate the potential 
recruiter’s ability to succeed at recruiting duty include 
expert systems, personal interviews, and testing 
procedures. Of interest to this thesis, in particular, are 
the conclusions reached as a result of research that used 
tests to predict recruiter performance. 

The most recent test developed is the ..Recruiter 
Selection Test Battery (RSTB, also called the Special 
Assignment Battery by the Marine Corps). Two studies, one 


published in 1981 and one published in 1986, found that the 


eu 


RSTB could be used to consistently  predige a tacmuee 
success for those recruiters who scored in the lowest 
pemcentl legscon the exam [fRef. 3 and Ret eae A 
recommendation of these studies was that the Navy should 
consider using the RSTB as an aid in Selecting recruiters 
for recrimsing ditty. 

This thesis investigates the feasibility of the 
recommendation to use the RSTB. This research attempted to 


answer the following questions: 


a. Can the RSTB be used to predict recruiter success? 


b. Are certain individual skill levels (RSTB 
subscales) more common among successful recruiters? 


c. Are the results of this validation consistent lwiee 
previous validation studies? 


d. Finally, can readily available information on 


IngGividual  chacaeceents ties be used to predict 
recruiter success as well or better than the RSTB? 


The answers to these questions are addressed below. 


A. CONCLUSIONS 

Production data and biodemographic information were 
gathered on a sample of 236 recruiters who took the RSTB in 
1982. The productivity ar eee recrieees was examined at 
two different levels to determine whether or not they were 
successful while on recruiting duty. Cross tabulation. 
between RSTB scores and production rates showed that 
performance on the RSTB was not a consistent predictor of 
PECGRCT IV ty ee Ee. ere na. Only those recruiters who 


scored in the highest percentile of the selling skills 


S2Z 


subscale also performed “the best" in the field. However, 
the recruiters who scored in the lowest section of this 
subscale had success rates that were greater than the next 
two higher divisions. These results were inconsistent with 
the two previous validations of the RSTB. 

Another cross tabulation, separating recruiters’ 
productivity and RSTB scores into upper 50th percentiles 
and lower 50th percentiles, showed that, in every instance, 
individuals who scored in the upper 50th percentile had 
equal or better rates of success than those scoring in the 
lower 50th percentile. However, the test statistics 
revealed that the differences between the upper and lower 
scoring recruiters, in most cases, were insignificant. 
Therefore, it cannot necessarily be said that if one scores 
imeene upper 50th percentile on the RSTB, his or her 
Mereential for success on recruiting duty is improved. 
Cross tabulations between average productivity and the RSTB 
recruiter potential composite score also confirmed this 
Semelusion. 

Correlation analysis provided the same mype of 
inconclusive result. Again, the RSTB subscale with the 
most significant correlation with production rates was 
selling skills. However, this relationship appears to be 
tenuous, at best, with a coefficient of only .087 and a 
Hevel of Significance of p= .18. Negative relationships 


between the human relations and organizing skills serve to 
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underscore the difference between the results of this 
analysis and the results of prior correlation analyses. 
Correlations between biodemographic characteristics and 
productivity were also examined. Biodemographics of the 
recruiters that were considered include Armed Forces 
OQualitii cation Test (AFQT ) scores, age, marital and 
dependents status, high school graduation, race-ethnicity, 
primary military occupational specialty (MOS), and the 
geographic Mecations of @irecrugema.e Gduieye The amy 
variables that were significantly related to productivity, 
and that could sensibly and potentially be used to select 


personnel for recruiting duty, were race/ethnicity and MOS. 


es 


Because AFQT scores were negatively related to produceuwims 
and this was unexpected, this author is hesitant to make 
any conclusions about selecting recruiters based on their 


lower AFQT scores. 





The conclusion that could be drawn from these results 
would be to select only minorities and individuals with the 
Navy Counselor. occupational specialty for recruiting duty. 
This, however, does not seem very realistic since personnel 
with these qualities are in relatively limited supply in 
the Navy. Thus, the conclusion to be reached at this 
juncture is that there is no real improvement in predicting 
the success of recruiters when using biodemographic 
information over uSing RSTB scores. 

Multivariate regression analysiS using both the RSTB 


scores and biodemographic variables to explain productivity 
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and success results in much the same conclusion. Using 
Ordinary Least Squares as a method for estimating the 
effects of the variables on average yearly production rates 
produced a model with four significant variables (all 
biodemographic). However, these variables only explained 
.0O8 percent of the variation in recruiter productivity and 
only two of these variables could be used as screening 
criteria for potential recruiters. These are age, and 
again, the Navy Counselor occupational specialty. a 

It was speculated that older recruiters may be 
approaching the end of their Navy career and, therefore, do 
wer possess as much motivation for succeeding as do younger 
personnel. Another explanation for the negative effects 
that age has on productivity may be attributable to the 
relationship that exists between age and pay grade. Senior 
recruiters are more likely to be the Leading Petty Officers 
or Supervisors of a recruiting Sif Tee. Their 
administrative burdens may affect the number of enlistment 
contracts that they are required or able to obtain. Since 
there iS no way to verify either of these hypotheses using 
mre Gata collected for this thesis, policy implications 
regarding the age of persons selected for recruiting duty 


@eammot be’ identified. 


Finally, formal models of recruiter success were 
estimated using logistic regression. Success was defined 
using two different levels of productivity. Judging from 


Meewcorrect Classifications oferecruiters resulting from 


these models, one could speculate that these models were 
very effective at predicting recruiter success. In every 
model, however, there were only two or three statistically 
significant variables. The only variable, in each model, 
that haS any meaning to the recruiter selection process is 
the Navy Counselor Mos. Therefore, the usefulness of 
elther the OLS or logit models created for this research as 
aids to recruiter selection is very limited. 

Overall, as a result of the analyses conducted, the 
answers to the guestions posed at the start of this study 
are: 

a. The RSTB cannot be used to predict recruiter 
success with any amount of certainty. 

b. It appears that higher selling skills scores, as a 
Subscale of the RSTB, may be more common among 
successful recruiters, but this relationship is 


somewhat tenuous. 


c. The resuits of this validation show very little 
consistency with previous validations of the RSTB. 


qd. The only individual characteristic that has a 


possibility of being useful, at this time, as a 
screening aid for potential recruiters is the 
occupational specialty of Navy Counselor. The 
practicality of using this criteria is 
questionable. 


B. RECOMMENDATIONS 

Despite inconcluSive results concerning the RSTB as a 
predictor of recruiter success, two recommendations should 
be considered with respect to other aspects of this 
research. The number of losses for medical discharges and 


retirement from recruiting duty within this sample is 
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Sebstonemal @1G) CUuEMN@ie, 236 recruiters). Therefore, it 
should be emphasized to all Navy commands that correct and 
accurate completion of the potential recruiter screening 
form is essential. Because the form requires a 
certification that the individual has no medical problems, 
accurate completion of the screening form could eliminate 
some of the losses from recruiting adauty for medical 
reasons. 

Also, the only tlength-of-service criterion currently 
being used to detail recruiters is that the individual be 
in pay grade E-5 or above. A possible policy change that 
may eliminate a large portion of the losses from recruiting 
duty as a result of retirement would be to simply limit the 
number of recruiters who are eligible for retirement. In 
this sample, at least eight of the recruiters did not 
complete a full three-year tour of recruiting duty because 
they retired. 

One consistent result throughout this research leads to 
the recommendation that personnel who have served as a Navy 
Seunselor should be actively pursued to fill recruiting 
@m@ey billets. Again, the feasibility of this, due to the 
relatively small number of individuals who meet this 
qualification, may be limited. 

Due to time constraints, there are several qreas ele te 
were not investigated using the data collected for this 
thesis that may be worthwhile to examine in future 


Besearchi. First, it 1S recommended™ that this sample of 


oF 


recruiters’ responses on the biographical portion of the 
RSTB be explored, in detail, for alternative variable 
definitions that may be useful in predicting recruiter 
success. Second, the productivity data available from the 
PRIDE system provide not only a raw count of vecrums 
contracts obtained by a recruiter, but also information 
concerning the “quality"™ of the recruit. Using these data 
will supply added criteria for judging recruiter success, 
and provide a more accurate picture of the recruiter’s 
success. 

It may be beneficial, because of the limitations 
encountered in using the PRIDE productivity data, to also 
search for alternative measures of success for use with the 
RSTB scores obtained for this thesis. These measures could 
include performance data, such aS supervisor or peer 
‘ratings, or performance evaluations. Another option is to 
locate a source, other than Navy Recruiting Command, that 
has maintained Freeman Transfer information on this group 
of recHhu1eers- 

Improving recruiter performance continues to be a key 
te the success of the all-volunteer military. Despite the 
results obtained in this thesis, with respect to the RSTB’s 
lack of predictive ability of recruiter success, previous 
studies have shown that the RSTB can be used to aid in the 
selection of recruiters. Further research (using this 
sample or the results from additional testing) will be 


needed before a final determination can be made of the 
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usefulness of the RSTB as a tool for selecting successful 


recruiters. 
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